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I. INTRODUCTION 



In recent years, new topological methods stemming from work done in the late 
nineteenth and early twentieth century by French mathematician and physicist Henri 
Poincare have been applied to the classical "analytical" theory of ordinary differential 
equations. The powerful discipline which has emerged has come to be known as "dy- 
namical systems theory'," with applications not only to continuous, but to discrete sys- 
tems as well, such as recursive or iterative feedback loops. One result of these methods 
is the ability to detect, describe, and measure the elusive phenomenon of "chaos." 

Simply put "chaos" is the occurrence of behavior that appears "random" in a 

deterministic dynamical system, that is, a system that changes in time governed at least 

in principle by certain known physical or mathematical laws. It is a phenomenon that 

is intrinsic to many dynamical systems, and not due to external influences such as 

"noise." Examples are wide-ranging, and include the motion of the planets, turbulent 

fluid flow, and population fluctuations. Additional applications have come from many 

fields of study, such as astronomy, biology, chemistry', ecology, economics, geology, 

mathematics, medicine, physics, and some social sciences, as well as various engineering 

> 

disciplines. In addition, many of these ideas have captured the public imagination, re- 
sulting in a great number of popular expositions. In recent years, various attempts have 
been made to codify these important concepts, and develop a rigorous unifying theory 
of "chaotic dynamics." 

This thesis introduces the reader to some of the methods of determining the presence 
of "chaos" in continuous systems as well as measuring it quantitatively. The information 
presented should be accessible to those with a knowledge of advanced calculus and or- 
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dinar}' differential equations, lo this end, the proofs of presented theorems which ex- 
ceed this knowledge are referenced for the interested reader. 






II. BASIC CONCEPTS 



A. SYSTEMS OF FIRST ORDER DIFFERENTIAL EQUATIONS 

We begin with a general system of first order ordinary differential equations ex- 
pressed in the vector form 



x’ =J[x.t), (1) 

with x' = — j— for .v = [.v„ .v, wj e U\ and /= [/,/ /] e IR", where each 

at 

/, i = I. 2,..., n assigns a real scalar value to every point x e IR" and time feR. Hence 
/: (R nM —i - IR, and so /: R n 1 — ► (R n . Lor example, with n = 3. equation (1) is equivalent 
to 



_ / 
- X 1 




1 


x 2 


= 


/(*!,. V 2 ,.V 3 , t) 


1 

1 




1 



Whenever possible vectors will be written in column form, however we may take the 
liberty, as was done for the vectors .v and f to write them as rows. The vector function 
/in equations (1) and (2) is defined as a vector field in (R n . In a non-autonomous system, 
/ depends explicitly on the variable t. An autonomous system is one in which /has no 
explicit time dependence; in this case equation (1) can be written as 

x' =/-v), (3) 



where / (R n — >• (R n for .r e IR". 
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It should be noted that higher order differential equations can be written as a system 
of first order differential equations. For example, consider the second order differential 
equation 



y" + 5 y' H — ly — 0. 



With new variables defined by 




(4) 



(5) 



we have 



V 




y' 




0v + 


iy" 


x 2 ' 




y" 




— 4 v — 


5y’ 



i.e., the original equation (4) is equivalent to the 2x2 system 



.t' = Ax, 



with A = 



: 0 1 

-4 -5 



( 6 ) 

(7) 

( 8 ) 



For methods of converting higher order differential equations to first order systems see 
Borrelli-Coleman [Ref. 2]. 
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The general form of a linear system of differential equations is 



1 

J^c 

1 




«n(0*i + • 


\ 

+ 

c 

c 

cT 

+ 


1 

* 

D 

1 




1 

a 

y 

+ 


• ^nnW-^Yi ^n(0 



where F t : R — * IR and each a„: (R — *■ [R, i = l...,n, j = l,..,n. Equivalently, 

.v' = A(i)x + F(t) (10) 



where A = («„(/)).=! n and F: IR -*• IR n is given by F = EF,,..., F n ]. If the linear system is 

J=1 n 

autonomous, then a n and l\ are constants. A nonlinear system of differential equations 
is one which is not linear. 

If the linear system is such that the functions F, are identically zero, then the system 
is said to be homogeneous and can be written in the form 



x' = A(i)x. 



( 11 ) 



.*!(/) is a matrix consisting of the same a„ as in equation (9). Again, if the linear homo- 
geneous system is autonomous, then the matrix A is constant, as in (7) and (8). 

It is also true that a non-autonomous system such as (1) can be written as an au- 
tonomous one. This is done by considering / as a dependent variable, increasing the size 
of the problem from nton+1: 



-v' =Ax,t) 
!' = 1 



( 12 ) 
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is equivalent to 



y = stv) 



(13) 



with 





.V 


n — 1 n+1 n l 




— 


_r_ 


e IR and g: R -* R given by g(r) = 


1 



Since any system can be written as an autonomous one, it will be assumed without loss 
of generality that the system is autonomous unless specified otherwise. 

The general solution to a system of differential equations - denoted 4>,{x) - is called 
a lion and equation (3) implies that </>/(.v) =J{4>.(x)). As an example, <f>,(x) for a third 
order system (i.e.. n = 3) takes the form 



4>,(x) 



*i (0 



■* 2 (0 • 



■*3(0 



(15) 



and defines a family of solutions or integral curves. An initial condition for the system 
(3) typically has the form .t(/ 0 ) = „t 0 , and physically prescribes a point .v 0 e R n through 
which the flow passes at time r = t 0 . Under certain conditions according to the basic lo- 
cal existence and uniqueness theorem of ordinary differential equations (see 
Coddington-Levinson [Ref. 3] ), this flow is uniquely determined, so that 4>, 0 (x) = .r 0 . 
Often, without loss of generality, time t 0 = 0 is chosen for the initial condition; then 
4> 0 (x) = -v 
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B. ASYMPTOTIC BEHAVIOR OF FLOWS 



One of the objectives of the modern theory of differential equations, or dynamical 
systems, is to describe the global rather than just the local behavior of flows. To this 
end, we introduce a number of definitions and then provide several examples to illustrate 
them. 

The forward orbit of a flow 4>,{x) based at a point x e 1R" is defined as 
{</>,(*)•• 0 < t < go) . The backward orbit of 4>,{x) is defined as {</>,(.r): — oo < / < 0}. The 
full orbit of a flow 4>,(x) is defined as {<t>,{x): — oo < / < oo}. We remark that an orbit is 
also sometimes referred to as a trajectory. 

A point p e 1R" is an equilibrium or stationary point if x 0 = p implies that 4>,(x) — p 
for all t > 0. These correspond to critical points of x(t), and so may be found by setting 
,v' = 0 in equation (3). A periodic orbit of period T is defined as a set {4>,(x): 0 < i < T} 
for some T > 0 such that </> T (.v) = .v. If </>,(.v) ^ .v for any 0 < / < T, then T is the funda- 
mental, minimal or prime period for 4>,{x). The flow of an equilibrium point can be 
viewed as a periodic orbit of period zero. A quasi-periodic orbit is an orbit that is not 
periodic, but which can be written as the sum of "incommensurate" periodic orbits. As 
an example, the flow 



4>,(x) = cos 2t + cos Jit (16) 

defines a quasi-periodic orbit. It is written as a sum of periodic orbits, but is not itself 
periodic since 2 and Jl are incommensurate (i.e., A, 2 + k ls Jl ^ 0 for any A,, k 2 integers, 
both not equal to zero). 

Equilibrium points and points of a periodic flow can be viewed collectively as a 
single set of points. These sets of points are specific examples of what will now be de- 
fined as an invariant set. An invariant set A of a flow is a set such that 0,( A) = A, where 
we define 0,(A) = jJ 0 ( (x). 
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A closed invariant set is stable if for every £ > 0, there exists a <3 > 0, such that 
||.v — A|| < <5 implies that \\<f>,(x) — A|| < £ for all r > 0 (i.e., a flow which starts at a point 
close to A. will stay close to A). I lere 'INI is the standard Euclidean distance in IR\ and 
||.r — A|| is defined as the greatest lower bound of ||.v — y|| for ally e A. A closed invariant 
set A is asymptotically stable if it is stable and if there exists a 3 > 0, such that 
||.v — A|| < 3 implies that ||</>.(.v) — A|| -> 0 as / — ► oo. (i.e., a flow which starts at a point 
close to A, will get arbitrarily close to A as time advances). A closed invariant set A is 
unstable if for every £>0 there exists a 3 > 0, such that ||.t — A|| < 3 implies that 
||</>,(.v) — A|| — ► 0 as / -» — oo (i.e., a flow which starts at a point close to A. will get arbi- 
trarily close to A in backward time). We remark that many authors choose to deline a 
closed invariant set as unstable simply if it is not stable. The limit set A of a How is 
defined as the set of all points p such that <f>,(x) — ► p as / -» + oo. Note that by con- 
struction, A is an invariant set. 

The following examples of systems of differential equations are provided to illustrate 
some of the previous definitions. 

Example 1 - Population Equation (one dimension) 

x' = r(M — x)x (17) 

This differential equation can be used as a simple model of bacteria growth in a Petri 
dish. The constant r is the positive rate of growth, and .VI is the positive limiting pop- 
ulation constant due to factors such as the size of the Petri dish. 

Although this equation can be solved using methods of ordinary differential 
equations, a qualitative graph of its solutions can be formed using simple analysis. First, 
note that the constant functions .v = 0 and jc=M are equilibrium solutions of (17). 
Moreover, if either .t < 0 or x > M, then .v' <0, so that .v decreases with increasing t. 
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Likewise if 0 < jc < M, then x' > 0, so that .v increases with increasing t. Using this 
analysis the family of solutions is plotted for t > 0 in Figure 1. 

A phase diagram is one which eliminates the variable t by projecting the flow curves 
onto the space IR n of the .v-variables. The direction of How is shown schematically by 
arrows. Obviously, since this process results in an n-dimensional portrait, it can only 
be visualized for n= 1, 2. or 3. The phase diagram for the above population equation 
is shown in Figure 2. 

As observed above, the population equation has two equilibrium points: x = 0 and 
.v = M. These points can be calculated by setting ,v’ = 0 (i.e., r( M — ,v).v = 0). Notice 
that flows with initial points in (0, oo) tend toward M as t increases, and away from \1 
as t decreases. This can be seen by either the plot of solutions or the phase diagram. 
Thus the point M (or more precisely, the closed invariant set A = {.VI}) satisfies the de- 
finition of an asymptotically stable equilibrium point, or sink. Note also, that (lows of 
points near but not equal to zero tend away from zero as t increases, and tend toward 
zero as i decreases. Thus zero satisfies the definition of an unstable equilibrium point, 
or source. 

Example 2 - Simple Pendulum (two dimensions) 

V = x 2 

2 . ( lS ) 
x 2 ' = to" sin .v, 

This system of differential equations describes the motion of a pendulum moving 
without friction or air resistance. The variable v, is the angular displacement of the 
pendulum from the vertical, x 2 is the angular velocity, and tu = g/L, where g is the 
gravitational constant and L is length of the pendulum. The process of finding the ex- 
plicit solution to this system of differential equations is described in Borrelli-Coleman 
[Ref. 2]. 
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X 




Figure 1. Population Flows 

The graph of che family of solutions, if plotted, would be in three dimensions with 
variables .v„ x 2t c. The plot of the phase diagram is in two dimensions, however, and 
provides sufficient illustration. The phase diagram is plotted in Figure 3. 

The equilibrium points of the simple pendulum are (mr, 0) for n e 2. Again, these 
can be obtained by setting x' = 0 (i.e., x,' = 0 and x 2 ' = 0 ). Notice that flows with initial 
conditions near the equilibrium points (2/nr, 0) for n s 2 neither converge toward nor 
diverge from these points, but instead form periodic cycles around them. Hence these 
equilibrium points are stable but not asymptotically stable, and the associated cycles 
physically correspond to simple harmonic oscillations of varying amplitudes. The re- 
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Figure 2. Population Phase Diagram 

maining equilibrium points ((2 n— l)rc, 0), nsZ have flows which converge to and di- 
verge from them. Hence these points are neither stable nor unstable, and are sometimes 
referred to as saddle points. 

We remark, that an asymptotically stable (respectively, unstable) invariant set for a 
system can also exist in the form of a limit cycle - a simple closed curve y having the 
property that nearby trajectories (either interior or exterior to y ) spiral towards (re- 
spectively, away from) y . This phenomenon is typically illustrated by the Van der Pol 
equation, which models a triode oscillator. The Poincare-Bendixson Theorem essentially 
asserts that any bounded invariant "limit set" of a planar flow is either an equilibrium 
point, limit cycle, or union of such objects. This fact is in marked contrast to the be- 
havior of discrete flows, and of differentiable flows in dimensions higher than two, where 
more exotic limit sets, such as "strange attractors," can exist; see Guckenheimer-Holmes 
[Ref. 4]. 

C. INVARIANT MANIFOLDS 

As stated earlier, a linear homogeneous autonomous system of first order differential 
equations can be written 



.t' = Ax, 



(19) 



where A is a matrix of constants. 
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Figure 3. Pendulum Phase Diagram 

Theorem 1: If A is n x n and has n independent eigenvectors [v lt vj, with corre- 
sponding eigenvalues [/,, .... >.J, then the family of solutions for (19) is 

4>,{x) = c 1 v l e / ’' 1 ' 4- ... 4- c n v n Q Xn ‘, (20) 

where c,, .... c n are arbitrary constants. 

Proof: (Sketch) Note that .r = 0 is always a solution to the homogeneous system 
x' = Ax. Suppose there exists a nontrivial solution to .r' = Ax of the form .v = ve Jt , 
v # 0. Substitution of this solution into x' = Ax yields Xv = Av, thus / is an eigenvalue 
of A and i' is its associated eigenvector. Due to the linearity of the problem, a linear 
combination of solutions is a solution, and by a fundamental theorem of ordinary dif- 
ferential equations, all solutions must be of this form since we have a full set of linearly 
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independent eigenvectors. The details can be found in Borrelli-Coleman [Ref. 2] and 
Bovce-DiPrima [Ref. 5]. 

The c, are determined once an initial condition .v(0) = ,v 0 is given. If a given initial 
point _r 0 lies in the direction of one of the real eigenvectors v,, then equation (20) becomes 

4> [ (x) = c j v/> t . (21) 

Thus the flow through ,v 0 at r = 0 remains in the direction of v,. If >,<0, then 
clearly. 4>,(x) -> 0 as t -> + oo; likewise if >., > 0. then (j> r {x) -> oo as t -> + co. If /, = 0 
then (21) reduces to <f>,{x) = c,v, = ,\- 0 (i.e., any ,v 0 in the direction of v, is an equilibrium 
point). 

For the case of complex eigenvalues /, = y. + \fi and eigenvectors 
;• = Re);-} + ilm);-,}, i = N -1 . the following can be shown. If the initial condition .v„ lies 
in the plane spanned by Re{v,} and Im{y} then equation (20) can be written in real form 
as 



< ) = c )1 e’ </ cos (h + c j2 e’ tr sin (h. (22) 

This implies that the flow remains in the plane spanned by Re);-,} and lm{;-} and forms 
a spiral due to the trigonometric functions, which are oscillating, bounded, and periodic. 
The direction of the spiral depends on the sign of a. If a < 0, the (low spirals in toward 
the origin. If a > 0, the flow spirals out toward infinity. If a = 0, the (low forms a pe- 
riodic cycle about the origin. The constant (i determines the rate at which the flow 
spirals. 

It should be noted that for a real matrix A , if -1, is a complex eigenvalue then its 
associated eigenvector v, is complex. In addition, the complex conjugate of /, is nec- 
essarily an eigenvalue and has associated eigenvector vj. Note that Re)/!,} is equal to 
Re{I,}. 



13 



With these cases in mind, one can divide 1R" into three classes of invariant subspaces 
called eigenspaces. The stable eigenspace is defined as E s = span{v,, v’ 2 , q,}, where 
v,, is, q, are the eigenvectors associated with eigenvalues that have negative real parts 
with <3 = dim(E ! ). The unstable eigenspace E u = spanfic,, w 2 , ... vq}, where it?,, vv 2 , ;q 
are the eigenvectors associated with eigenvalues that have positive real parts, and 
e = dim(E u ). The center eigenspace E c = span{«,. u 2 , ... » y }, where u„ u 2 , ... u y are the 
eigenvectors associated with eigenvalues that have real parts equal to zero, and 
y = dim( E c ). The sum of the dimensions for the eigenspaces is equal to the dimension 
of the entire space K" fi.e., o + o + y = n). Keep in mind that for complex eigenvectors 
v,, and q the spanning vectors for the appropriate eigenspace are Re{q} and lm{q}. 
Figure 4 is a general phase diagram illustrating the three eigenspaces: a) n=2, with 
a = 1 , y = 1 . b) n = 2. with a = 1 . a = 1 , and c) n = 3. with <7 = 2.0= 1 . 

For example, consider .v' = Ax where 



110 0 



A = 



0 



2 0 0 

0 0 -1 



0 0 10 



(23) 



A has eigenvalues 0, 3, -1+i, -1-i and associated eigenvectors [1,— 1.0, 0], 
[1, 2,0,0], [0,0,0, -l] + i[0,0, 1,0], [0, 0, 0, — 1] — i[0, 0, 1,0] respectively. Thus 

E s = span{[0, 0, 0,-1], [0,0, 1,0]}, E u = span{[l , 2, 0, 0]}, E c = span{[l, - 1, 0, 0]}. 

It is always true that zero is an equilibrium point for x' = Ax, regardless of A. Note 
that for A n x n, if the dimension of E‘ is equal to n then zero is an asymptotically stable 
equilibrium point. If the dimension of E u is equal to n. then zero is an unstable equi- 
librium point. 
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c ) _u 




Figure 4. Eigenspaces 

The subspaces E\ E“, E c are easily formed when the matrix A has n independent 
eigenvectors. If the matrix A does not have n independent eigenvectors, the "missing 
ones" can be constructed using techniques described in Boyce-DiPrima [Ref. 5]. These 
"generalized" eigenvectors are placed in the appropriate eigenspace depending on the real 
part of its associated eigenvalue. 

For a linear system, flows can be classified rather easily. For a nonlinear system, 
this is generally not the case. A common method in describing the dynamics of a non- 
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linear system is to linearize it in a neighborhood of an equilibrium point, so that the 
analysis above may be applied locally. Given a nonlinear system x' =J[x) and an equi- 
librium point p , the linearized system is given by 

-v' = Ax. (24) 



where A = [)/(/>) = 
ample, with x e (R 3 . 



Cf 1 




_ dx < 


j= 



is the Jacobian matrix of f evaluated at p. 



For ex- 



Dy(;>) = 





d A 


o/ 


dx, 


d- x 2 


dx 3 


dfl 


0/2 


*A 


cx x 


OX 2 


dx 3 


to 


Of. 3 


^A 


dx \ 


5 . v 2 


dx 3 



x=p 



(25) 



We need the following definitions. The local stable and unstable manifolds of p, 
W'ljp), W’L(p) respectively, are defined as follows: 

S 

W,oc(p) = (-V e U: </>/.v) — > p as / -* + oo, and c/> ; (.v) e L for all t > 0} (26) 

w ioc ip) = {-*■ e U: 4>,(x) -* p as t — — OO, and 4> t (x) e L’ for all / < 0} (27) 

where Lcr(R n is a neighborhood of p. The Stable Manifold Theorem below loosely states 
that nonlinear systems "resemble" linear systems on a local scale, in the sense that the 
dynamical roles of the invariant eigcnspaces (lines, planes, or "hyperplanes" in higher 
dimensions) are now played by invariant curves, surfaces, or "manifolds" in general. 
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Theorem 2: Suppose that DJ[p) has no eigenvalues with real part equal to zero. 
Then there exist unique local stable and unstable manifolds W[ oc (p), W“ oc (p), of the same 
dimensions as those of the eigenspaces F\ F" of the linearized system (24), and tangent 
to E\ E“ at p\ see Figure 5. 

Proof: Guckenheimer-Holmes [Ref. 4] references the proof, which uses the Implicit 
Function Theorem from advanced calculus. 

An example which uses the result of Theorem 2 is the nonlinear system 

V = x \ 

, (28) 
,V 2 ' = xf - x 2 

which has a unique equilibrium point at the origin (0.0). The associated linear system 
about the point (0,0) is 






"1 0 ] 
0 -I 



(29) 



D/(0,0) has eigenvalues 1 and -1 with associated eigenvectors [1,0] and [0, I], re- 
spectively. 

Thus by Theorem 2, the nonlinear system about the point (0,0) has a one- 
dimensional unstable manifold \V,' J OC (0,0) tangent to [1, 0], and a one-dimensional stable 
manifold W| oc (0,0) tangent to [0, 1]. This can be verified by direct computation. First, 
if.v,(0) = 0 (i.e., an initial point is chosen on the .xyaxis), then it follows by solving the 
first equation of (28) that x,(r) = 0 for all t > 0, and thus by the second equation of (28), 
-xr,(r) — > 0 as i * = oo. Hence W[ oc (0) = B ! (0). Moreover, the explicit solution to (28) 
can be represented (non-parametrically) by the curves x 2 = y-v,"+ C.r, ; then W“ oc (0) is the 
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Figure 5. Schematic for Theorem 2 

parabolic member of this family corresponding to C = 0. Figure 6 depicts the 
eigenspaces and manifolds for this example. 

The local manifolds Wj^j), have global analogues independent of the U in 

(26) and (27) which are defined by letting c -* - oo and r -» + oo, respectively: 

w s (p)= U 4>mM) (30) 

W V)= ^^AW^)) . (31) 

If DJ[p) has eigenvalues with real part equal to zero, then there also exists a corre- 
sponding center manifold W *(/>), tangent to, and having the same dimension y as, the 
center eigenspace E c . The existence of W^), which need not be unique for a given sys- 
tem, is the content of the Center Manifold Theorem. The dynamics of a system on this 
manifold are generally more complicated than on the others, and a detailed analysis is 
beyond the scope of this thesis. Guckenheimer-Holmes [Ref. 4] provide a detailed 
discussion of center manifolds. 
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Figure 6. Eigenspaces and Manifolds 

Clearly, by definition. W'(p) and W *{p) are invariant under the flow and 

p e W '{p) Pl W '‘{p). If there exists a distinct point q e W ‘(p) F| W "(p) as well, then it fol- 
lows that -* p as t — ± oo, and q is said to be a horaoclinic point to p, with corre- 
sponding homoclinic orbit (p.{q), -oo < t < oo. Clearly, if q is homoclinic to p, then so is 
any other point in the orbit <£,(?)< hence there will be an infinite number of such points 
in general. Figure 7 illustrates a homoclinic orbit. 

The formation of homoclinic points and orbits plays an important role in the de- 
velopment of chaotic dynamical behavior, as will be observed in subsequent chapters. 
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III. DEFINING CHAOS 



A. POINCARE MAPS 

As we shall see, there are many ways to approach the definition of "chaos." We 
begin with one such approach. Poincare maps. As seen earlier, one way to help char- 
acterize the dynamic behavior of a nonlinear system of differential equations is to 
linearize it in a local area. Another technique is to discretize it. By analyzing "snap- 
shots" of a continuous solution, we can infer certain properties about it. These "snap- 
shots" (discretization) form the foundation for Poincare maps. 

We start with a third order (.r e (R 3 ) autonomous system and a suitable two- 
dimensional surface (for example, a plane) n such that the flow 4>.(x) under observation 
repeatedly intersects n transversely (i.e., nontangentially). The image of a point xe Id 
under the first return or Poincare map P: II -* n is defined as that point along the flow 
4>,(x) which next intersects the surface n . Varying definitions are possible if the direc- 
tion in which </>,(x) crosses n is taken into account. There are also cases where a well- 
defined Poincare map is not possible. Moreover the definition of a Poincare map can 
be extended to the general case .v e IR", n > 3. Instead of using a two-dimensional sur- 
face for n , a hypersurface of dimension (n-1) is chosen. Figure 8 shows the con- 
struction of a Poincare map for x e IR 3 . 

As with continuous systems, discrete systems have their own accompanying set of 
definitions and properties. A common example of a discrete dynamical system is an it- 
erated function. Although the following definitions are stated for one dimension we will 
show how they can be extended to higher dimensions. 

Given a function g: IR -* IR and an initial value x 0 e IR, the sequence 
{xq, g(x 0 ), g(g(x 0 )), g(g(g(x 0 ))), ...} is defined as the forward orbit ofx 0 under g . Note that 
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the recursive formula ,v n _ , = g(.r„) with initial condition x 0 is an equivalent definition for 
the forward orbit. Provided that g has an inverse, the backward orbit of .r 0 under g is 
defined as {.t 0 , sT'Or'C^))’ (This definition can be generalized by using 

g-‘(.v) = {y e R: g(y) = .r}.) The full orbit of under g is defined as 

{•••.g' l (S' 1 (*o)).S' l (*o)* *o,gl-*b).s(s(>o)).»-}- Forward and backward orbits of g are com- 
parable to the forward and backward orbits of a flow (/>,(.v) in the continuous system. 
Thus, the sequence of points {.r 0 , x u x 2 , ...} generated by the intersection of the flow 
<i>,(x) with II in Figure 8 is the forward orbit of a point x a under the Poincare map 

P-. n - n. 

In discussing iterative functions it is convenient to use the following notation: 



£ n (-v) = ( gogo^og)(x ), 
n times 



( 32 ) 



for n= 1,2,3,..., where the symbol o denotes function composition, and g n (x) = (£’'(jr)) n . 
The point p is defined as a fixed point of g if g{p) = p. A point q which is not a fixed 
point is defined as eventually fixed if g m (q) is fixed for some m e Z . More generally, a 



point p is periodic of period n if g n (/>) = p. Note that if p has period n, then it automat- 
ically has periods of all (positive) integer multiples of n. This motivates the next defi- 
nition: a point p is periodic of prime period n if g n (p) = p and there does not exist an m 
such that 0 < m < n and g m (p ) = p. A point q which is not periodic is defined as eventu- 
ally periodic if g m {q) is periodic for some meZ . 

The definitions above extend to spaces other than IR. For example, consider code 
space ! , the collection of all infinite binary strings s, e {0,1}, and the shift map 

g: E -» 1 given by 



£(V 2 s 3 ...) = s 2 s 3 s^... . (33) 

The fixed points of g are 000, 11 1 (The bar indicates an infinite repeating block). The 
point 01000 is eventually fixed. The point 001001 is a periodic point of prime period 
three. The point 10001001 is eventually periodic. 

Given that g is differentiable the following definitions also hold. A periodic point 
of prime period n is hyperbolic if | ( g n )'(p ) 1^1. Note that a fixed point is equivalent to 
a periodic point of prime period one. Thus a fixed point is hyperbolic if | g'(p) | # 1. Also 
note that ( g n )'(p ) in general is calculated by the Chain Rule: 

(g n )'(/>) = £'(g n ‘'(/>)) ••• g’{g(p))g'(p) • (3-4) 

For example, if p is a periodic point of prime period three of the sequence 
0=1, g{p) = 0, g 2 (p) = - 1 , g } (p) = 1, ...} then 

O 3 )'(l)=g'(-lk'(0k'(l) • (35) 

Clearly, this is also the common value of (g 3 )'(0) and (g 3 )'(-l). A periodic point p is 
non-hyperbolic if | (g n )'(p) \ = 1. A periodic point p of prime period n is attracting if 
I (g n )'(p) I < !• The point p is repelling if | (g n )'0) | > 1. A good introductory reference 
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that covers chaos for discrete systems is Beaver [Ref. 1], A more rigorous treatment is 
found in Devaney [Ref. 6], 

For higher dimensions IR m the iterative system takes the form 



(36) 



equivalently, 

*n-l=S(*n) (37) 

where .v e ffT and g: (R m - |R m . 

Definitions for higher dimensions extend in the obvious manner with the exception 
of the hyperbolic, attracting and repelling periodic points. A periodic point p of prime 
period n is hyperbolic if the Jacobian matrix D(g n )(/>) has no eigenvalues of unit modulus, 
that is, no eigenvalues on the unit circle | z | = 1 in the complex plane. (We remark that 
this definition extends to all points of any limit set A; in this case we say that the entire 
set A is hyperbolic.) The Jacobian can be computed with the aid of the Chain Rule as 
before: 



V (D „<b (v (l) v (2) v ( m)) 

’ K n - 1 * v* n » - l n > **•’ ’'■n / 

r (2) 0 (2) (v d) v (2) v (mK 

~ 1 ^ v l n » ’ K n * ***’ -'n f 



v (m) 

- x n- I 



g (m \4'\4 2) 4 m) ) 



D(g n )(^) - D g(g n -'(p)) ... D*te(p))Dj&>). (38) 

The multiplications above are matrix multiplications. If all the eigenvalues of D(g”)(^) 
have modulus less than one then the periodic point p is attracting. If all the eigenvalues 
have modulus greater than one, p is repelling. An attracting fixed point can be shown 
to be asymptotically stable, and hence is sometimes referred to as a sink. Likewise a 
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repelling fixed point is said to be a source. If some eigenvalues lie in the interior of the 
unit disk while the remaining ones lie outside, then a fixed point p is a saddle point. 

As one might expect, eigenspaces and manifolds exist for discrete systems similar to 
those just discussed in the previous section for continuous systems. The position of the 
eigenvalues in relation to the complex unit circle is the determining factor for discrete 
systems, as opposed to continuous systems where it is their position relative to the im- 
aginary axis (i.e., stable if Re{/} < 0, unstable if Re{z} > 0, etc.). The interested reader 
is referred to Guckenheimer-I lolmes [Ref. 4], 

We now return to the process of using the information gained by Poincare maps to 
characterize the behavior of an n m order nonlinear continuous system. Recall that in this 
case, the Poincare map is a mapping between two (n-l)-dimensional spaces. 

By construction, a periodic orbit of a continuous system corresponds to a discrete 
periodic cycle of some Poincare map (Figure 9), such as a fixed point, for example. If 
the fixed point is stable then the periodic orbit is asymptotically stable. If the fixed point 
is unstable then so is the periodic orbit. If the fixed point is neither stable nor unstable 
it is possible to relate the dimensions of the manifolds of the fixed point to the manifolds 
of the periodic orbit. The reader is referred to Guckenheimer-Holmes [Ref. 4] for a 
more in-depth discussion of the relation between the discrete manifolds of the Poincare 
map and the manifolds of the continuous system. 

A quasi-pcriodic orbit of a continuous system that consists of only two 
incommensurate periods corresponds to some Poincare map of embedded circles. For 
a quasi-periodic orbit of K incommensurate periods the Poincare map consists of a 
generalized (K-l) - tori. The idea is that for a quasi-periodic orbit the corresponding 
Poincare map is one of compact (closed, bounded) geometric structure. For a discussion 
of Poincare maps corresponding to quasi-pcriodic orbits sec Parker-Chua [Ref. 7]. 
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Although we have yet to define chaos, those continuous orbits which are chaotic 
have corresponding Poincare maps whose images are very distinctive and often quite 
beautiful. These images are distinctive in that they seem to possess a more complex 
geometric structure than those of periodic or quasi-periodic orbits. In an effort to 
quantify this apparent increased complexity, various definitions of "dimension" have 
been formulated which for these exotic sets can take on non-imeger values. Several of 
these definitions are discussed in a subsequent chapter. 



B. SMALE HORSESHOE 

We continue our approach toward a definition of chaos with the following example 
of the Smale Horseshoe map, a two-dimensional discrete map that exhibits many of the 
features which are normally associated with "chaotic" dynamical systems. This map can 
arise as a Poincare map for a three-dimensional autonomous system. It is also closely 
related to homoclinic orbits which were briefly introduced at the end of the section on 
manifolds. 
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Before beginning our example a few preliminaries are needed. We have already seen 
how the ability to relate the dynamics of one system to another can be very powerful. 
Another much stronger method for accomplishing this relation is topological conjugacy. 

Let S and T be sets; the function h: S -» T is a homeomorphism if it is continuous, 
one-to-one, onto and has a continuous inverse. Two maps / S -» S and g: T —> T are said 
to be topologically conjugate if there exists a homeomorphism h: S -> T such that 
h of = g o h. The function h is defined as the topological conjugacy. Figure 10 is a 
schematic for topologically conjugate maps /and g. and we say that the diagram "com- 
mutes." 



The following is an example of two topologically conjugate functions. Let 

S = [0,1], T = [-|, }]. and let / S - S. g: T -+ T. and h: S -> T be given by 



Since h o g = g o h and h is a homeomorphism. the functions /, g are topologically con- 
jugate. 

The power of this relation is that topologically conjugate maps / and g have com- 
pletely equivalent dynamics. If / has a stable fixed point p then g has a stable fixed point 
h(p). More generally, any given orbit of /is mapped to a corresponding orbit with 
equivalent dynamics in g via the homeomorphism h. For the example above, p = 0 is a 
non-hyperbolic fixed point for / and h{ 0) = 0.5 is a non-hyperbolic fixed point for g; 



JU) = -v( I - -v) 
g(.v) = .v 2 + .25 



( 39 ) 



h(x) = —x + .5 . 



Then 




(40) 
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Figure 10. Topological Conjugacy 



equivalent dynamics are in Fact suggested by comparing the graphs of/ and g, respec- 
tively. 

Thus if we are able to establish a topological conjugacy between a map with un- 
known dynamics and one with which we are well acquainted, then the dynamics of the 
original map will be completely known. As expected, it may not be an easy task to es- 
tablish such a topological conjugacy. 

The other concept we will need in discussing the Smale Horseshoe is one we have 
already covered for continuous systems. An invariant set A for a general map /: S -*• S 
is a subset AsS such that J{ A) = A, where /A) = {/l-*/ x s A}. Fixed points and periodic 
sequences are trivial examples of invariant sets. A method of constructing an invariant 
set for/, which may not be trivial, is to take the infinite intersection of the forward it- 
erates of the entire domain and intersect them with the corresponding backward iterates, 
that is, 



bO 

a = n 

a — -co 

= lim 

m— oo 



As) 



n As) . 

n=-m J v ' 



(41) 



It is this construction which we will use to obtain an invariant set for the Smale 
Horseshoe map. 



2S 



Let S be the unit square I 2 ; contract it vertically by a factor of one-quarter, and ex- 
pand it horizontally by a factor of four. Next bend it into a horseshoe-like shape and 
superimpose it back onto the unit square S. Call this geometric mapping/. The map 
/ S -> S can be formulated algebraically but the geometric presentation promotes clarity, 
and is diagrammed in Figure 11. 

Let m= 1 in (41); the first iteration /( S) consists of two horizontal bars which we 
have labeled 11° and 1 1 1 . In order to find the backward iterates, perform the map in re- 
verse. This process is shown in Figure 12, and results in two vertical bars, labeled V° and 
V 1 , respectively, such that J\\ T °) = 11 and y(V') = II 1 . The intersection of one forward it- 
eration and its backward iteration is shown in Figure 13, and results in four shaded 
blocks which contain the invariant set A. Each block can therefore be represented as 
some ll’ 1 H V ! °. where s.,s 0 e (0,1). which then corresponds to a unique binary address 
of the form j,.s 0 , also shown in Figure 13. Thus, any point .v in such a block has the 
property that .re V*° and .re II 1 , the latter of which implies that / (.v) e V s ' 1 . This sug- 
gests that the vertical bars V 0 and V 1 may eventually be used as the basis for tracking the 
orbit of a point in A via a binary sequence. 

Let 1X1=2 in (41); we now consider the forward and backward iterations of the 
intersection depicted in Figure 13. These second forward and backward iterations are 
shown in Figures 14 and 15. Notice that the second forward iteration gives rise to four 

horizontal bars which arc subsets of 11° and H 1 . (Equivalently, these four horizontal bars 

2 

can also be characterized as /( S); see Figure 16.) The second backward iteration results 
in four vertical bars. Like the horizontal bars, the four vertical bars are subsets of V° 
and V 1 . The intersection results in sixteen blocks (see Figure 17) which contain A, and 
may be assigned four-digit binary addresses according to a prescription similar to that 
given above. 
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Figure 1 1. First Forward Iteration 



In general, the n ,h forward iteration will result in 2 n horizontal bars which are subsets 
of the 2"' horizontal bars of (n-l) lh forward iteration, and likewise for the vertical bars 
with respect to backward iteration. By taking the infinite intersection of the forward it- 
erates of S and intersecting them with their corresponding backward iterates, we con- 
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Figure 12. First Backward Iteration 



struct (by the Heine-Borel Theorem of advanced calculus) a nonempty invariant set A 
of f, and a map h on A such that each and every point .v e A has a corresponding ad- 
dress, or itinerary, h(x), which is representable by a binary bi-infinite sequence: 
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/i(.r) = ...s. 



(42) 



where 



f 0, f\x) e V° 
l • 1 

U/WsV . 



(43) 



This sequence is similar to the code space used in (33) except that it is bi-infinite. We 
will denote this space of binary bi-infinite sequences as S'. It is possible to show that 
the map h: A — S' is a homeomorphism. and is an example of the use of symbolic dy- 
namics. 

Finally we define a shift map g: S' — S' such that 

^(...S.jS.tS.i.SqSiSj...) = ...S.jS.iSq.SjSiSj... . (44) 



Theorem 3: The maps / and g defined above are topologically conjugate with 

topological conjugacv h . 
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Figure 14. Second Forward Iteration 

Proof: The proof of this theorem is closely linked to the proof of Theorem 5.1.1 
of Guckenheimer-Holmes [Ref. 4], 
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irm 




Figure 15. Second Backward Iteration 

Since /and g are topologically conjugate we can equate the dynamic behavior of g 
with that of/. The map g has certain properties which will form the definition for chaos 
in the next section. 
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Our first goal is to show that two points in Z’, initially "close", start to diverge from 
one another under forward iterations of g . This property of a map is known as sensitive 
dependence on initial conditions. A mathematical definition is given by Devaney 
[Ref. 6]. A map g:T-*T has sensitive dependence on initial conditions on T if there 
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Figure 17. Second Iteration Intersection 

exists c > 0 such that, for any .teT and any J-neighborhood N of .r, there exists y e N 
and n > 0 such that dlg-^.r), g"(y)) > t. 

In the previous definition d(s, f) represents an appropriate "distance measuring" 
function, or metric for the space T. For our example the space T is equal to Z' and 



OO 

d<,-o "Z‘ L i^’ (j5) 

1= — OO 

for s = and t = in Z'. Using the definition of sensitive dependence on 

initial conditions it is possible to show that the map g, and thus /, has this property with 
respect to the metric given above. 

For example, suppose s and c agree in positions i= -100 to 100 and disagree in the 

-99 

remaining positions. Then s and t are initially "close" to one another: d(5,f) < 2 . 

201 201 

However after 201 iterations of g, g ( 5 ) and g (r) are quite widely separated: 
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201 201 

dfg (5), g (/)) > 2.99. In this way, given any arbitrarily small neighborhood N of s we 

n n 

can find a distinct point t in N such that d(g (s), g (/)) > 2.99 for some n > 0. Since / and 
g are topologically conjugate there are exactly two points x and y in A that correspond 
via the homeomorphisnt h: A -» S' to the sequences s and t in S'. Hence / exhibits sen- 
sitive dependence on initial conditions on A . 

Our second goal is to show that g is topologically transitive. Devaney [Ref. 6] de- 
fines a map g: T — > T as topologically transitive on T if for any pair of open sets 

|( 

L’,V a T there exists k > 0 such that g (L’)DV 0. that is, any two subsets of T even- 
tually intersect. If g contains a dense orbit, that is. if there exists a point i in S' whose 
orbit becomes arbitrarily close to all points in S'. then it follows that g is topologically 
transitive. 

Consider the point i constructed in the following manner: 

s = ...0.0 01 10 M 0000 00 0 1 ... 1 1 1 1 000000000001 ... ... 

all 2-blocks all 4-blocks all 6-blocks 

During the first seven iterations, the orbit of s will have agreed in the i = -l and i = 0 
positions with every point in S'. There arc only four possible binary numbers of length 
two and in seven iterations the orbit of s has covered them. 

In the next 64 (2 4 x 4) iterations the orbit of s will have agreed in positions i= -2 to 
1 with every point in S'. The construction of s is such that in a finite - although possibly 
large - number of iterations, the orbit of s will agree in positions i = -n to n-1 with every 
point in S', for any n > 0. In other words, the orbit of s gets arbitrarily close to every 
number in S'. 

Our final goal is to show that periodic points are dense in S' (i.e., show that every 
point in S' has a periodic point arbitrarily close to it). Consider any point s e S', then 
s can be represented as 
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5 — ••• 5 -n-l 5 -n-*-n - l"- 5 -l- s O- s l-'- 5 n-l- s n 5 n- !••• • 



(47) 



Choosing an arbitrary distance between s and a periodic point pel' is equivalent to 
choosing an n sufficiently large that p and s agree in positions i = -n to n. Thus construct 
p in the following manner: 



The bar underneath indicates repeated blocks to the left and the bar on top indicates 
repeated blocks to the right. Note that p agrees with s in positions i = -n to n and is 
periodic of order 2n+l. By constructing p in this manner we have shown that any 
s e Z' has a periodic point arbitrarily close to it. Therefore periodic points of" are dense 



In summary, g: Z' -* Z' is a map for which 

1. g has sensitive dependence on initial conditions. 

2. g is topologically transitive, 

3. periodic points of g are dense in Z'. 

Since g is topologically conjugate to the Smale Horseshoe map / A -* A, /and g share 
these three properties. 

There is in addition an intimate connection between this map and the existence of 
homoclinic points, which we will state more precisely in the following chapter. Recall 
that a point q is homoclinic to a fixed point p if q =/= p and q e W *(/>) f) Now, since 

y(V°) = if, it follows that the block V° f) if is mapped to itself by/, hence it contains a 
fixed point p having itinerary 0.0 . Clearly, any point q with itinerary 05 m ...s l .s 0 ...5 n 0 has 
the property that 




(48) 



<4 sV). /(</))-* 0 as k-*±oo, 



(49) 
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thus q e \V s (/>) H \V», and there are infinitely many such intersection points q. More- 
over. we may similarly construct a point q satisfying (49) for any point p e A; in this case 
q is both forward and backward asymptotic to p, respectively. 

1 he convoluted intertwining of the stable and unstable manifolds is a result of the 
shrinking, stretching, and folding effects of the map and leads to sensitive dependence 
on initial conditions, topological transitivity and dense periodic points (see Figure IS). 
For this reason, in practice, the numerical detection of horseshoes in a particular dy- 
namical system is often identified with the presence of chaos. 

It should be noted that the Smale Horseshoe map has many variations. Although 
our map contracted and expanded by orders of four they can be generalized to a con- 
traction factor p , 0 < p < l/ : and an expansion factor /. . ) > 2. The orientation of the 
horseshoe with respect to the unit square need not be horizontal or vertical. Fven the 
unit square may be varied to other domains. 

Note also that the use of symbolic dynamics enabled us to take what were only ob- 
servations (geometric properties of the Smale Horseshoe map) and make them math- 
ematically precise. That is, we were able to perform rigorous analysis which was not 
possible earlier without the use of symbolic dynamics. 

The invariant limit set A also requires further discussion. It is constructed by an 
explicit procedure that results in a sequence of disconnected sets which have some in- 
teresting properties. Note that each of the small groups of four blocks in Figure 17 is 
a contracted and translated copy of Figure 13, as each block in Figure 13 is such a copy 
of the original unit square S in Figure 11. This property of self-similarity persists 
throughout the procedure and ultimately carries through to the invariant set A itself 
This kind of recursive construction - sometimes referred to as an iterated function system 
(1FS) - can be used as the basis for computer generation of other types of "fractal" im- 
ages. These limit sets may be viewed as "attractors" of certain "affine maps" (linear fol- 
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Figure 18. Intertwining of Stable and Unstable Manifolds 

lowed by a translation, thus representable by matrices) on subsets of R\ and therefore 
can be addressed by using a variation of code space. The resulting fractal attractor A 
is unique, and has "dimension" which is not necessarily an integer, but may be a frac- 
tional value, for example (and hence the name). For a discussion of iterated function 
systems see Beaver [Ref. 1]. 

The invariant Iimic set A of the Smale Horseshoe is itself closely related to a well- 
known subsec of the interval [0, 1], the Cantor Ternary or Middle-Thirds Sec. This set 
is constructed recursively by the repeated removal of open middle thirds from all current 
intervals. Thus, removing the open middle third from [0, 1] results in two closed inter- 
vals: [0, y] and [ y, 1]. Repeating this procedure results in four closed intervals: 
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[ 0 , 7 ], [ j, j], [ j, j] an ^ C T- !]• L'pon infinite iteration we are left with the Cantor 
set. Although this straightforward construction may seem rather trivial, the Cantor set 
has many interesting properties which are shared by the invariant set A . For example, 
both the Cantor set and the set A are totally disconnected, that is, for every .v e A there 
exists an open ball, B/.v) = {}’: d(.v v v) < 0 } centered at x of radius <5 which contains no 
points of A other than x. In fact, A itself may be viewed as a "higher dimensional" ver- 
sion of the classical Cantor set that exists in the unit square rather than the unit interval. 
For a more complete discussion of fractals and the Cantor set see Beaver [Ref. 1 ], 

C. CHAOS 

There is no universally accepted definition for chaos. For discrete systems we shall 
adopt the definition given by Devaney [Ref. 6], Let S be a set. The map / S -» S is said 
to be chaotic on S if 

1 . /has sensitive dependence on initial conditions, 

2. / is topologically transitive, 

3. periodic points of/are dense in S. 

Note that the Smale Horseshoe map is chaotic on the invariant set A . Also note 
that the Smale Horseshoe map is not chaotic on the set l 2 , the unit square, since periodic 
points are not dense in F (i.e. , we can find an open neighborhood in F which does not 
contain a periodic point). , 

In a recent article published in the American Mathematical Monthly [Ref. S], J. 
Banks et. al. prove the following theorem: 

Theorem 4: If/ S -» S is transitive and has dense periodic points, then /has sensitive 
dependence on initial conditions. 

Proof: A sketch of the proof follows. Let .v be an arbitrary 1 point in S, and <3 > 0. 
Define the open ball centered at x of radius 5 as B/r) = [y e S: d(.vj’) < d}. By the Tri- 
angle Inequality, it can be shown that there exists a periodic point q whose orbit, 0(<jr) 
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is of distance at least 46 from .xr. Since periodic points are dense in S, there exists a point 
p e which is periodic of, say, period n. There also exists a point z e B^.r) such that 
f\z) comes within <3 of one of the points in Oh/) for some integer j. This follows from 
the fact that f is transitive and requires careful construction of neighborhoods about the 
points in 0(</). Once again by way of the Triangle Inequality and the fact that 
f\p) = p, it can be shown that d(/ n '(/))./ n '(z)) > 26. A final application of the Triangle 
Inequality implies that either d(f"(x), /"(:)) > 6 or d(/' n '(. v )./ P '(/ 7 )) > 6. Thus for any 
neighborhood N of _r, there exists a point in X, either p or z, such that the distance be- 
tween them after n] iterations is greater than S . This is exactly the definition of sen- 
sitive dependence on initial conditions. For complete details see Banks et. al. [Ref S], 

Thus in order to show that a function / S — > S is chaotic, we need only demonstrate 
that periodic points are dense in S and /is topologically transitive. Theorem 4 implies 
that f will also have sensitive dependence on initial conditions. 

For a continuous system, chaotic dynamics are usually linked to the appearance of 
the Smale Horseshoe map (or one of its variants) in its associated Poincare map, giving 
rise to homoclinic points and orbits which can often be detected numerically. Alterna- 
tively, chaotic behavior is often described using quantitative measures such as various 
non-integer "dimensions" that are associated with "strange attractors." Loosely speak- 
ing, these are exotic Cantor-like limit sets which exhibit distinctive structure such as 
quasi-self-similarity, a property that is normally associated with "fractal" sets. We will 
discuss these topics in greater detail in the sections that follow. 

lake chaos, no single accepted definition for a "strange attractor" exists. In fact, 
definitions vary quite substantially. To illustrate this variance we provide the following 
two definitions for a "strange attractor." 

The first is provided by Rasband [Ref. 9] and is presented as a practical definition. 
A set A is called an attracting set for the dynamical system x' =J{x) with flow designated 
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by (pl-x ), if there is some neighborhood U of A such that 4>,(.x) e U for i > 0 and 
0,(.v) -* A (i.e., ||0,(.r) — ,-l|| -» 0) as t -* + oo for all .v e U. A strange attractor is then 
defined as an attracting set with non-integer "fractal dimension." Several measures of 
fractal dimension exist, some of which will be discussed in a later chapter. 

Before stating the second definition from Guckenheimer-I Iolmes [Ref. 4] we provide 
some preliminary ideas. A closed invariant set A is indecomposable if for every pair of 

points x,y in A and c. > 0, there are points .v = ,v 0 , .v, v n .,, .v„ = y and such 

that the distance from 0 ,_(.*•,.,) to .v, is smaller than c (see Figure 19). That is. for any pair 
of points .v and y in an indecomposable set, a "chain" of "nearby" (lows can be con- 
structed that links .v to y. 

The "Lebesgue measure" of a set l.'<=!R n is a non-negative real value that can be in- 
formally described as a generalization of the notion of length, area, or volume (for 
n= 1.2, or 3, respectively), and in fact, reduces to this in "simple" cases A set having 
positive Lebesgue measure need not however have a topological "interior" in IR n . (For 
example, the Lebesgue measure of the interval I = [0,l]c:(R is one, while that of the ra- 
tional numbers <Q> in I can be shown to be zero. From this it follows that the comple- 
ment, the irrational numbers I — <Q> in [0,1], has Lebesgue measure one, even though this 
set contains no open intervals.) A rigorous definition lies beyond the scope of this thesis. 
For an in-depth discussion of measure theory, see Royden [Ref. 10]. 

Recall that q is a homoclinic point to a fixed point p if q p and if 
q e W s (/>) p| \V u (p). A homoclinic point q is transversal if the tangent vectors to W s (/>) 
and W u (/>) do not coincide, and gives rise to a transversal hotnoclinic orbit, 
{</>,( <7): — oo < t < oo}. 

Guckenheimer-1 Iolmes [Ref. 4] provide the following definition for a strange 
attractor. An attractor is an indecomposable closed invariant set A with the property 
that, given £ > 0, there is a set U of positive Lebesgue measure in an c -neighborhood 
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of A such that x e U implies that 0. (. r) for some subsequence r„ as r, -* + oo, is contained 
in A and the forward orbit of x is contained in U. An attractor is called strange if it 
contains a transversal homoclinic orbit. This is called a chaotic attractor by some au- 
thors, and is consistent with the development of the notion of chaos in this thesis. 

Note that the condition, “x e U implies that <p,.(x) for some subsequence as 
r, -* -H oo, is contained in A found in the above definition is not as restrictive as the 
condition, "x e U implies <£ r (.t) -*■ A" found in the definition for an attracting set. It is 
also true however that the definition for an attracting set does not require the restriction 
that A be indecomposable. 
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Clearly these two definitions for a "strange attractor" are quite dissimilar. It should 
become apparent that chaos is a topic with much diversity which is yet to be unified. 

The last property we will mention that is associated with a chaotic dynamical system 
is the existence of positive "Lyapunov exponents." A continuous or discrete system with 
an attracting set that has a positive Lyapunov exponent is often classified as chaotic. 
This property is often associated with sensitive dependence on initial conditions. 

Before defining Lyapunov exponents and discussing them in-depth, we provide two 
examples of continuous third order autonomous systems which exhibit chaotic behavior: 
Duffing's equation and the Lorenz equations. It should be noted that a continuous 
autonomous system requires at least three dimensions in order for a strange attractor to 
be present. I his is a direct result from the Poincare-Bendi.xson Theorem which implies 
that an attractor for a continuous two-dimensional autonomous system can consist of 
only equilibrium points, periodic orbits or unions of these invariant sets (see Figure 3 for 
example), none of which possess a transversal homoclinic orbit or "fractal dimension." 
A presentation of the Poincare-Bendi.xson Theorem as well as the proof can be found in 
Coddington-Levinson [Ref. 3]. The theorem is presented in terms of limit points and 
limit sets of a semi-orbit. However, two-dimensional discrete systems can also give rise 
to strange attractors, such as the Smale Horseshoe map and the Ilenon map. See 
Peitgen-Jurgens-Saupe [Ref. 11] for examples of two-dimensional discrete systems with 
strange attractors. 
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IV. TWO EXAMPLES OF CHAOTIC SYSTEMS 



A. DUFFING'S EQUATION 



DufTing's equation is a second order dilferential equation of the form 



+ ex' + bx 4- ax = /.j\ t) 



( 50 ) 



where ' represents differentiation with respect to /, the coefficients a, b, c, / are real 
constants (c representing damping), and f: R -* R is a periodic forcing function with pe- 
riod T. 

Many phenomena have been modeled by an equation of this form, including the 
dynamics of a buckled elastic beam and the movement of a particle in a plasma. For 
our discussion we will choose the constants a and b to be equal to 1 and -1 respectively. 
With these choices equation (50) is equivalent to the following third order autonomous 
svstenv. 



We begin with the undamped unforced case: / = 0 and c = 0. A Poincare map 
P: II — ► □ can be formulated by choosing the plane H to be parallel to the /-axis. Spe- 
cifically, let FI be the .r„ x, plane where / = 0. In this case the image of the Poincare 
map is quite similar to the phase diagram for the DufTing equation (i.e., it is equivalent 
to sampling the phase diagram in intervals of T). 

l he Poincare map has three fixed points (-1,0), (1,0) and (0,0). These fixed points 
correspond to periodic orbits of period T for the continuous system (51). The Jacobian 




CXj + Af[t) 



(51) 



/' = 1 mod T . 
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matrices of P at (-1,0) and (1,0) have eigenvalues ± / v 3 . The Jacobian of P at (0,0) has 
eigenvalues + 1. The phase diagram and the image of the Poincare map arc shown in 
Figures 20 and 21. The point q in Figure 20 is a homoclinic point and the loops on ei- 
ther side of the point p = (0,0) arc homoclinic orbits. 

For c some positive value and ). = 0, the fixed points for the Poincare map remain 
(-1,0), (1,0) and (0,0); however only (-1,0) and ( 1,0) are attracting. These attracting fixed 
points correspond to asymptotically stable equilibrium points. The phase diagram is 
plotted in Figure 22. 

If we keep c positive and increase the forcing parameter / , the fixed points of the 
Poincare map shift and a transversal homoclinic point emerges near (0,0). Let p be the 
shifted fixed point from (0.0). Figure 23 depicts the changing manifolds of p and the 
emergence of transversal homoclinic points as ). increases. 

We now give some preliminary definitions prior to stating a special case of the 
Smale-Birkhoff Ilomoclinic Theorem, which relates the presence of a transversal 
homoclinic point to the shift map defined in discussing the Smale Horseshoe. A map 
P: OT — ' > R' is C 1 if all of its first partial derivatives exist and are continuous. The map 
P: R" -» IR is C if all mixed k ,h partial derivatives exist and are continuous for all k. A 
map P\ R~ -» R~ is a diffeomorphism if it is one-to-one, onto and C°°, and its inverse is 
also <T. Recall that a fixed point p of the map P: R 2 -> R 2 is hyperbolic if the Jacobian 
DP(p) has no eigenvalues of unit modulus. 

Theorem 5: Let P: R' -* R" be a diffeomorphism such that p is a hyperbolic point 
and there exists a transversal homoclinic point q =£ p. Then P has an invariant set A on 
which P is topologically equivalent to the shift map on U (binary bi-infinite sequences). 

It should be noted that the Smale-Birkhoff Homoclinic Theorem is a generalization 
of Theorem 5 to maps P: R n -> R n . 
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Figure 20. Phase Diagram for k = 0, c = 0. 

Proof: The proof of the Smale- Birkho IT Homoclinic Theorem is detailed in 
Guckenheimer-Holmes [Ref. 4], It links the geometry of a transversal homoclinic point 
to that of a Smale Horseshoe map by way of Markov partitions. 

We conclude from Theorem 5 that whenever the parameters are such that the 
Poincare map for a continuous dynamical system, in particular DutTing's equation, has 
a transversal homoclinic point then in the neighborhood of such a point the map has the 

same properties as the Smale Horseshoe: 

1. sensitive dependence on initial conditions, 

2. existence of a dense orbit, which implies topological transitivity, 

3. dense set of periodic points. 

That is, the Poincare map associated to Duffing's equation is chaotic whenever the pa- 
rameters are such that a transversal homoclinic point is present. There has been much 
work done on this equation, and much ongoing research as well; see Guckenheimer- 
Holmes [Ref. 4], 
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Figure 21. Image of Poincare Map for k = 0, c = 0. 

B. LORENZ EQUATIONS 

The "Lorenz equations" of meteorology are a third order autonomous system of 
differential equations. Formulated in an effort to model some of the unpredictable be- 
havior associated with weather, this system has become further popularized by the cha- 
otic dynamics it exhibits, such as the so-called "butterfly effect." It characterizes a fluid 
layer heated from below and cooled from above and is written in the following form: 

x' = a{y — x ) 

y' — rx — y — xz (52) 

z — xy — bz . 

The variables x, y and r represent convective motion and the horizontal and vertical 
temperature variations, respectively. The parameters a (Prantl number), r (Rayleigh 
number), and b (an aspect ratio) are positive real constants. Although this system has 
been analyzed for a wide range of parameter values we shall adopt the traditional ones 
where a = 10, b - y and r is varied. 
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For r ^ 1 the Lorenz equations accurately model the dynamics of a convective sys- 
tem. For r "far" from one the equations are not an accurate model for the fluid's dy- 
namics but have been used to model other physical systems. [Ref. 12] 

We begin by presenting properties of the Lorenz equations which are true for any 
values of a , r and b. First, there is a natural symmetry of variables under the transfor- 
mation (.t,y,r) — (-.r,-.y.r). That is, any dynamical behavior that occurs in a particular 
octant is reflected through the r-axis to the octant diagonally opposite. 

Secondly, the origin is clearly an equilibrium point for the Lorenz system for all 
parameter values. Moreover, if an initial point (0,0, z 0 ) is chosen, then direct inspection 
of the equations in (52) shows that jt'( 0) =/(0) = 0, and r'(0) — *^-o- Since r„ is arbitrary, 
this shows that the r-axis x =y = 0 is invariant, i.e., flows which start on the r-axis stay 
on it, and furthermore, tend toward the origin (0,0,0). Thus the r-axis is contained in 
W‘(0). 

We will show that there exists an ellipsoid Ec:R 3 for which the flow along the 
boundary is always directed inward. This implies that there exists a bounded attracting 
set A defined by 



50 




••<= ,Q>«E). 



(53) 



To see that such an ellipsoid E exists, consider 



-3 x 2 . / . Z 2 



E a = {(*^) e R : + — + — - (r + l)z - .u = 0} 



(54) 



for n a positive constant. Showing that the dot product V of the velocity vector for (52) 
with the outward normal vector of E a is always negative implies that the flow is always 
directed inward along E„: 



V = . 



dE 

dx 



+y 



3. 

dy 






5E , 

dz 



= —x 2 — y 2 — bz 2 ■+• bz{r + 1) . 



( 55 ) 
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If (xy,z) is on the ellipsoid E„, that is. 




(56) 



then 



\ - ( — 1 + — — ).v 2 + ( — 1 - — )v' — 

2 O 




(57) 



which is negative for sufficiently large u. 

Note that any ellip^soid which contains ll u in its interior will have the (low along its 
boundary always directed inward. This implies that any flow starting a finite distance 
from the origin will stay a finite distance from the origin (i.e.. no flows tend toward in- 
finity). 

The linearized system of (52) has Jacobian equal to 



- a a 0 



r — z 



(58) 



y -v -b 



At the origin „y = y = z = 0, the Jacobian is 



-a a 0 



r -1 0 



(59) 



0 0 -b 



which has eigenvalues 



-{a + 1 ) + y (<? — 1 ) 2 + 4 GY 



(60) 
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For r < 1 all eigenvalues of (59) are less than zero (i.e., the origin is asymptotically sta- 
ble). In fact, all solutions, not just those in some small neighborhood, tend toward the 
origin. Note that in this case the attracting set A defined in (53) consists of only one 
point, namely the origin, and W ! (0) = IR 3 , i.e., the origin is "global" sink. See Figure 24 
for a phase diagram schematic with r < 1 . 

For r= 1 the eigenvalues of (59) are 

/ 1 = 0, /. 2 = -(<7+l), )-i = -b. (61) 

Two eigenvalues are negative and one is equal to zero. Thus for r = 1 the origin is no 
longer asymptotically stable but still satisfies the definition of a stable equilibrium point. 

As r becomes greater than one. two additional equilibrium points 
= ( N b(r — \) . x b(r — 1) . — 1) and q~ = (- N b(r — 1) , - N b(r — 1) . r — 1) appear which 
are initially asymptotically stable. The origin is now neither stable nor unstable for 
r > 1 . This transition as the parameter passes through r= 1 is an example of a 
"bifurcation." A discussion of bifurcations for continuous systems can be found in 
■Guckenheimer-Holmes [Ref. 4], 

For r> 1 two eigenvalues (>. 2 , >. 3 ) of (59) are negative and one (/,) is positive. By 
Theorem 2 of Chapter II the unstable manifold \V U (0) at the origin has dimension one 
and \V ! (0) has dimension two. The eigenvalues for the Jacobian matrices evaluated at 
q~ and q all have real parts negative when 1 < r < r u . (When < 7=10 and b = j, 
r H ~ 24.74 .) The equilibrium points < 7 * and q~ are asymptotically stable. The attracting 
set A now consists of three points: the origin, q~ and q~. See Figure 25 for a schematic 
for r close to but greater than one. 

For 1 < r < r H the How along the unstable manifold W u (0) approaches q~ and <7 . 
For r-valucs moderately larger than one, flows which start nearer to q r will spiral in to- 
ward it and those which start nearer to q~ will spiral in toward that. As r increases past 
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a critical value r' , the flows along the unstable manifold "cross over" and spiral in toward 
the "opposite" equilibrium point. (When a = 10 and b = y, r’ ^ 13.926.) At r = r' 
homoclinic orbits exist which contain the origin. See Figures 26, 27 and 2S for sche- 
matics for 1 < r < r ' , r = r and r < r < r H respectively. 

As r is increased past r H , the equilibrium points q~ and q~ are no longer stable. The 
attracting set A increases in complexity. Using a version of symbolic dynamics similar 
to that of the Smale Horseshoe, it is possible to show that the Lorenz equations can 
eventually be classified as chaotic on A through the formation of transversal homoclinic 
orbits. Figure 29 illustrates a numerical solution of the "Lorenz attractor," projected 
onto the .rr-plane with a = 10, b = y and r = 60. It is also possible to show that A is a 
strange attractor, possessing non-integer "fractal dimension;" see Rasband [Ref. 9]. 

The Lorenz equations are filled with much richness that we have not discussed. 
They exhibit horseshoes, a phenomenon known as "period-doubling" and also undergo 
a series of "homoclinic explosions." Sparrow [Ref. 12] provides a detailed analysis of 
the Lorenz equations. 
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Figure 25. Phase Diagram r> 1. 




Figure 26. Phase Diagram 1 < r < r' . 




Figure 27. Phase Diagram r = r' . 
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Figure 28. Phase Diagram r' < r < r H . 
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Figure 29. Numerical Solution: (<x = 10, b = j, r = 60.) Picture is from Sparrow 

[Ref. 12]. 
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V. QUANTITATIVE MEASURES OF CHAOS 



A. LYAPUNOV EXPONENTS 

Up to now we were concerned with defining chaos and deciding whether or not a 
system was chaotic. Quantitative measures of chaos not only indicate when chaos is 
present in a dynamical system, but attempt to capture the degree of this behavior by 
assigning it a numerical value. Lyapunov exponents are one such quantitative measure. 

Lyapunov exponents are numbers which measure the amount of exponential diver- 
gence or convergence between flows with "close" initial points, and are normally associ- 
ated with a flow 4>,(x) (specifically a bounded flow such as on an attractor). Of most 
concern is the largest Lyapunov exponent. If the largest Lyapunov exponent of an 
attractor is positive then it would seem plausible that the attractor would have sensitive 
dependence on initial conditions. In fact many authors call a system chaotic if the 
largest Lyapunov exponent for an attractor is positive. 

The full definition of Lyapunov exponents is somewhat involved, and the following 
non-rigorous argument suffices as motivation for the definition of the largest of them. 
Let A be a scalar, and consider the first order autonomous differential equation .v' = ax, 
,v(0) — .v 0 , the solution of which is = .v 0 e ,lr . Thus, a pair of initial points separated by a 
distance d 0 > 0 and allowed to flow from time 0 to time t eventually become separated 
by a distance d(t) = d Q c 1 '. If / >0, then the flows diverge exponentially, regardless of 
how close they were initially/ 

.More generally, let 4>,{x) be a bounded flow on an attractor, and let d(i) represent 
the distance between the flow <p t (x) and some "nearby" flow at time t. Suppose now that 
d(i) = d 0 (i)e 1 ' for some "initial distance" function d a (t) and scalar A. Then A is said to be 
a Lyapunov exponent for the flow 4> r (x). For k= 1,2,...,N as t runs from some time 
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/ k ., to a close but later time / k , a "small" initial distance of </„(/*.,) between these flows is 
multiplied by an exponential growth factor. That is, locally, 






(62) 



Beyond this time value of if the growth rate of d(i) becomes "too large" for exponen- 
tial growth, then a new’ "nearby" flow' is chosen w’ith a new’ initial distance </ 0 (/J, and the 
process is repeated; see Figure 30. The form of formula (62) suggests that 



Summing from k= 1 to N and taking an appropriate limit yields a precise definition: 



finis the largest Lyapunov exponent for the flow </> : („r) can be estimated by averaging 
the local expansion rates over time. Other expressions for / exist, as well as versions for 
flow’s of discrete maps. It should be noted that the choice of the exponential e in (62) 
is arbitrary; base 2 is often used. 

Another method for estimating the largest Lyapunov exponent for a bounded flow’ 
4> t (x) follow’s. We first provide the following definitions. Let L be a matrix with complex 
elements /„. A matrix L is defined as the Hermitian conjugate matrix of L if the elements 
l {] of L are equal to the complex conjugates of the elements of L transpose (i.c., 
/* — Ij. The trace of a n x n matrix L, Tr(L), is equal to the sum of its diagonal elements 




(63) 



\ 



/ = 




(64) 



(i.c., Tr(L) = I/„). 
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Figure 30. Estimation of a Lyapunov Exponent 

Instead of defining a Jacobian matrix evaluated at a single point, consider 
D/(<p ,(*)), a Jacobian matrix evaluated for an entire flow. It depends on the parameter 
t and is illustrated by the following example. Given a flow for the Lorenz equations 



4>,{x) = 



x(t) 

At) 

r(0 



(65) 



we have 
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- a 



a 0 



i WX-v)) 



r-:(t) - 1 --v(/) 
j(/) x(f) -b 



( 66 ) 



It is possible to relate the distance </(/) between </>,(.v) and a "nearby" flow by the fol- 
lowing expression: 



ci'{t)= Dy(0 f (.v)K(r). (67) 

An analytic solution for </l i) using (6“) is virtually impossible except in some special 
cases. However. (67) can be integrated numerically such that 

</(/) = LUH('o) (6S) 

where L ( r) is a matrix with the same dimension as Dy(0 r (x)) (i.c., n x n ). The largest 
Lyapunov exponent is the average of the eigenvalues of L(/) with the largest real part 
as i goes from zero to infinity. Mathematically, for / the largest Lyapunov exponent, 

'.= -^-ln[Tr(L + (/)L(/))] (69) 

where L is the llermitian conjugate matrix of L and Tr(L’(r)L(/)) is the trace of the 
matrix product L*(/)L(/). The limit in (69) has been established by "multiplicative 
ergodic theorems" to exist for a large category of systems. 

It should be noted that an entire spectrum of Lyapunov exponents exists, largest to 
smallest. In general, for an n th order autonomous system there are n Lyapunov expo- 
nents. The spectrum of Lyapunov exponents for an equilibrium point p of the system 
,v' =J[x) consists of exactly the real parts of the eigenvalues of the Jacobian DJ{p). 
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For an attractor to exist it must be true that the sum of the Lyapunov exponents is 
negative. It can also be shown that for a system a-' = J[x), if </>,(x) is bounded for t > 0, 
if does not tend toward an equilibrium point, and if /has a finite number of zeros, 
then at least one of the Lyapunov exponents for </>,(.v) is zero; see Parkcr-Chua 
[Ref. 7], 

With the last two statements in mind the only possible spectrum of Lyapunov ex- 
ponents (/ !, z. 2) / 3 ) for a three-dimensional system with an attractor is one where / > 0, 
A 2 — 0, / 3 < 0 and < -/j. 

B. FRACTAL DIMENSION 

Fractal dimensions are dimensions which allow non-integer values. The dimension 
of Euclidean space is the dimension with which we arc most familiar and is not consid- 
ered a fractal dimension. It assigns only integer- valued dimensions; a point has di- 
mension zero, a line dimension one, a plane dimension two, and a cube dimension three. 
Fractal dimensions arc consistent with the dimension of Euclidean space in that a point, 
line, plane and cube all have the appropriate integer valued dimensions. 

We are most concerned with defining an appropriate dimension for invariant sets, 
in particular, strange attractors. Note that we have already seen that strange attractors 
can be defined as attracting sets with non-integer fractal dimension. Inasmuch as most 
(but not all) strange attractors exhibit chaos in the sense of possessing transversal 
homoclinic orbits (and thus sensitive dependence on initial conditions, etc.), the dimen- 
sions of non-chaotic attractors arc always integers. 

We start with a notion of fractal dimension called capacity. Given an attractor A, 
cover it with appropriate volume elements (i.e., spheres, cubes, circles, squares, intervals, 
etc.) each with diameter c. Let X(c) denote the number of volume elements with diam- 
eter £ needed to cover A. As £ decreases the number of volume elements N(c) needed to 
cover A increases, that is, 
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(70) 



N(£) = C£ D 

for some constants c , and D. The capacity D cap is derived by solving (70) for D and let- 
ting £ approach zero, that is, 



lim In N(c) 
ca P ln( -L) 



(71) 



provided the limit exists independent of the shape of the boxes used to compute \(£). 
If the limit does not exist, the capacity is undefined. Capacity is also known as box or 
box-counting dimension. 

Consider the capacity for the unit square. Let the volume elements be boxes with 

sides of length £ = • If k = 1 then nine boxes are necessary to cover the unit square. 

j ' 

Lor k = 2. eighty-one boxes are necessary. In general X(£) = 3" boxes are necessary to 
cover the unit square. Letting £ — ► 0 is equivalent to letting k — ► oo, thus 



D 



cap 



lim 

k-*oo 




(72) 



Notice that two is consistent with the Euclidean dimension for the unit square. 

Now consider the Cantor Ternary set briefly introduced in Chapter 111. This set is 
a subset of the unit interval and thus the appropriate volume elements will be intervals. 
After completion of the first step in our construction of the Cantor Ternary set we were 
left with two intervals [0, y], [y,l], These intervals can be covered with two intervals 
of length one-third. In general after the k lh step, N(e) = 2“ intervals of length £ = tire 
sufficient to cover the resulting set. Thus the capacity of the Cantor Ternary set is 



D 



cap 



lim 

k-*-oo 



In 2 k _ In 2 
In 3 k ln 3 



0.6309 . 



(73) 
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Notice that D cap is not an integer and that the value is less than the dimension of the unit 
interval (dimension one) of which the Cantor Ternary set is a subset. 

In calculating the capacity for attractors such as those found for DufTing's equation 
and the Lorenz equations, note that equation (70) can be written as 

In X(c) = D(ln <-!-)) + In c . (74) 

Thus, in a limiting sense, D cap is the slope of the log-log plot of N(£) versus -j- . 

N(c) can be calculated for an appropriate number of different c-values by con- 
structing a grid of boxes (hyper-cubes) with sides of length £ that cover an area (n- 
dimensional phase space) which bounds the attractor. For Dutfing's equation, n = 2. 
and boxes are used for volume elements. For the Lorenz equations. n= 3, and cubes are 
used for volume elements. This grid of boxes (hyper-cubes) can be initialized in a 
boolean array with value FALSE. For each data point .v, on the attractor determine in 
which box it is contained and change the corresponding array value to TRUE. \(e) is 
the number of elements in the array which are marked TRUE. 

It should be noted that for n greater than three, computer memory requirements 
become excessive. In this case other more efficient methods (see Parker-Chua [Ref: 7]) 
can be used for calculating D cap . Additionally the number of data points .r, on the 
attractor used in calculating the capacity as well as the other fractal dimensions is crit- 
ical. We will return to this issue at the end of the section. 

The next measure we shall discuss is called the information dimension. We maintain 
the notation that \(e) is the number of volume elements of diameter £ which covers the 
attractor. The information dimension is based on the relative frequency that the 
attractor "visits" any particular volume element. Uet P, be the relative frequency with 
which the attractor enters the i th volume element. Define 
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The information dimension is defined bv 



_ lim * 

1 «-o in(d-) ' 



(76) 



Again if the limit does not exist D, is undefined. 

Consider the information dimension for the unit square with uniform probability 

1 

density. 1 hen as seen earlier N(e) = 3' boxes with sides of length £ = — are necessary 

to coyer the unit square. Since the probability density is uniform, the probability that 

a point chosen at random from the unit square is in a box with side of length £ = ^rr is 

equal to -4r (i.e., P, = -^r). Thus 
j j 



!!(£) = - 





,2k 

J 



(77) 



and the information dimension is 



D,= 



lim 

k-+oo 



In 3 



,2k 



111 



TT = - 



(78) 



Notice that D, for the unit square with uniform probability is equal to D cap for the 
unit square. In fact it is always true that D cap = D, for uniform densities. 

Next consider a unit square with uniform probability density equal to y and the 
single point (2,0) with probability y. If the volume elements are again boxes with sides 



of length £ = — , then N(e) = 3 2k + 1 boxes are necessary to cover the unit square plus 
the point (2,0). P, = -7 for the volume element covering the point (2,0) and 






for the remaining 3' volume elements. Thus 



1 1 (f) = — 7 In -j- 



1 



1=1 



7~^F ln i -7-^r 

1 • J \ 1 • J 



= In 2 + ± In ( 2 . 3 2k ) 
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= In 2 + -7 In 3^ 



and 



D,= 



lim 



( In 2 In 3 2k 

\ In 3 k 21 n 3 k 



= I . 



(SO) 



Thus D, is the average of the dimensions of the point and the unit square. This illus- 
trates how the information dimension can weigh the lower-dimensional subsets accord- 
ing to their relative frequency of "visitation," where as capacity tends to ignore the 
lower-dimensional subsets. It can be shown for any attractor that D, < D„ p . 

The final fractal dimension which we shall discuss is the correlation dimension. 
Keeping the same notation used for information dimension, the correlation dimension 
D corr is defined by 



in Y p; 



67 



As an aid to interpreting the numerator of (81), let N be the number of points x, of 



the attractor used to estimate I) 



C(£) = 



lim 

N — »oo 



corr . It is rather easy to show that for 

— 3 - {the number of pairs of points 
{.v r .Vj} such that ||.v, — .vjl < e] ’ 



(82) 



(SI) is equivalent to 



i-) _ lim [ l£l 

c° rr c—o i n £ 



(S3) 



Once again consider the unit square and a single point. Let the volume elements 
be boxes with sides of length c = -Jr • Then N(c) = 3 2k + 1. Let P, = -J- ^ rJr ^ for the 
volume elements covering the unit square and P, = — for the .single point. Then 



\(£) 




1=1 




which implies 




(8-4) 



(85) 



= 0 . 

Thus the correlation dimension completelv ignores the unit square in this example. It 
can be shown that D cc ,rr ^ Di ^ D C 3 P for any attractor. 
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Other similar types of fractal dimensions exist which are also designed to reflect 
various statistical properties of the attractor. Related measures include entropy, 
Hausdorff dimension, and Lyapunov dimension which requires the values for the entire 
spectrum of Lyapunov exponents. This probabilistic approach to analyzing dynamical 
systems has played an important role in the development of a formal discipline known 
as ergodie theory, which relies heavily on the classical theory of measure and integration. 
The main reason for choosing one fractal dimension over another is the ease and accu- 
racy of calculation, as well as computational stability and robustness. Since this area is 
still undergoing much active research it is unclear which dimensions are preferable and 
how they are related to one another. It is unlikely that the complexity of a strange 
attractor will ever be represented by a single number. 

Much of the power in determining an attractor's fractal dimension is realized when 
working with data from experimental observations (i.e., time series). This provides an 
estimate of the minimum number of variables needed to model the systems' underlying 
dynamics. For example, if the dimension of the attractor is 2.7 then theoretically the 
underlying system can be modeled with three variables. 

This leads to two questions: 

1. How reliable is computational simulation of the true orbits? 

2. I low much data is necessary to estimate the fractal dimension of an attractor? 

The first question is answered by the Shadowing Lemma, see Guckenheimer-Holmes 
[Ref. 4], which states that a computed "pseudo-orbit" does approximate some true orbit 
in a hyperbolic invariant set A. The second question is answered (specifically for cor- 
relation dimension estimated by the widely used Grassenberger-Procaccia algorithm) in 
Ruelle [Ref. 13]. Let X be the number of points on the attractor or number of exper- 
imentally observed data points used to estimate the correlation dimension. It can be 
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argued that in order for the correlation dimension to be estimated accurately by this al- 
gorithm the following relation must hold: 

correlation dimension < 2 log 10N • (86) 

Thus if the correlation dimension is estimated to be 3.7 for a certain attractor then we 
should ensure that substantially more than 71 data points were used in the estimation. 
Although the relation in (S6) is specific to a fractal dimension calculated by a certain 
algorithm, the result suggests we should in general be wary of any fractal dimension es- 
timated with a "small" number of data points. 
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APPENDIX - NOTATION 



We provide the following definitions for some of the fundamental mathematical 

notation used in this thesis. 

1. a e A - a is a member of set A 

2. IR - the set of real numbers 

. IR" - the set of n-tuples (x, ,v n ), where x, el, i = l,...,n 

4. Z - the set of integers, {0, +1. ±2, ...} 

5. Z - the set of non-negative integers, {0, 1, 2, ...} 

6. Q - the set of rational numbers. { : m.n e Z. n # 0} 

7. f: A — ► B - a function / with set A as its domain and set B as its range 
S. hof - composition of functions. hoJ\x ) = fi(j{x)) 

9. Re{/} - the real part of the complex number / 

10. Im{/.} - the imaginary part of the complex number / 
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